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Abstract 

We study a deterministic dynamics with two time scales in a continuous state attractor network. 
To the usual (fast) relaxation dynamics towards point attractors ("patterns") we add a slow cou- 
pling dynamics that makes the visited patterns to loose stability leading to an itinerant behavior in 
the form of punctuated equilibria. One finds that the transition frequency matrix between patterns 
shows non-trivial statistical properties in the chaotic itinerant regime. We show that mixture input 
patterns can be temporally segmented by the itinerant dynamics. The viability of a combinatorial 
spatio-temporal neural code is also demonstrated. 
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Several complex systems present a non-uniform rate of change, where stationary states 
( "patterns" ) suddenly loose their stability and are substituted by new ones. Such punctuated 
behavior has been observed in a wide range of time scales from evolutionary, economic, 
social and weather dynamics, to brain behavior and laboratory devices such as laser cavities 
. Usually this "itinerancy" between states is thought as "thermal" transitions between 
deep valleys in a rugged landscape, possibly in the glassy dynamics regime. Such process, 
by definition, is stochastic so that times of transition and the choice of the next pattern are 
random. In this work, we consider the opposite spectrum of systems where the loss of the 
patten, 8t a Wli t y b d ue to interna, de—tie m eenan ismS flflflQ. Of course, natural 
systems certainly falls between these two descriptions. 

The specific model studied here is a multistable system where the relevant transitions 
occur when a stationary state (a point attractor) looses stability so that the system falls 
into a new point attractor, and so on, forming an itinerant trajectory (see Fig.HJ. The more 
general case of itinerancy between several kinds of attractors (limit cycles, torus and low 
dimensional chaotic attractors) has also been studied (see, for example, the special volume 
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Our model consists of a continuous state attractor network |8( storing P patterns with 
an added slow anti-Hebbian dynamics 0, ^ | (which may represent some coupling self- 
regulation by negative feedback). The model has a discrete time parallel dynamics with a 
full connected network, that is, it is a mean field coupled maps model: 

Si(t+l) =tanh[ 7 (/e i (t) + / i (t))], (1) 

where Si, the state of neuron i = 1, . . . , N, is a real variable in the interval [—1,1], hi is the 
local field hi(t) = Y^j=i JijSj{t), and Ij(i) is an (eventual) external input. The parameter 7 
is the transfer function gain (in this paper, 7 = 10). Notice that we have called the units 
"neurons" only by convention, since they could be better interpreted as neural populations 
or basic units in a network (like glomeruli in the olfactory system, species in ecological 
systems, population of agents in social systems etc). With this interpretations, the mean 
field character present in the model is more plausible. 

Eq. (^) defines the dynamics for the fast variables Si(t) given the coupling matrix Jy. In 
our model, this matrix is slowly time dependent: 

Mt) = $ + J$(t) , (2) 
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FIG. 1: Schematic phase space showing an itinerant walk between point attractors. 

where there is a constant Hebbian ("correlational") component J?j that stores P patterns, 
defining a basic attractor landscape, and a time dependent anti-Hebbian part J^(t) that 
modulates this landscape and produces the escape events. 
The Hebbian component has the usual form: 

where £ M = {£f }, i = 1, . . . , N; fi = 1, . . . , P are random patterns to be stored. For conve- 
nience, we use binary random variables £f = ±1. As usual, we set J u = 0. 

The present state S(£) of the system modulates the "energy" landscape (defined by slow 
variables </#(£)), so that if the system is visiting a local minimum, that minimum slowly 
looses its stability until turning out a saddle or a maximum and an escape event occur. 
The change in the attractor landscape, however, is transient, having only an exponentially 
decreasing memory of the past visited states. So, the anti-Hebbian component has the form 



3 



4{t + 1) = (1 - \)Jfa) - jjSiWSj® . (4) 

The initial condition is J^(0) = 0. The first term (the "coupling memory decay") guarantees 
that any change produced by visiting some state vanishes with characteristic time r after the 
escape from that state. The second term is the anti-Hebbian contribution, parametrized by 
a step size e and scaled by 1/N to preserve compatibility with Eq. (jSJ). So, the transition rate 
between patterns (or even the possibility of such transitions) depends on the two parameters 
r and e. 

The matrix Jfj defines a permanent landscape of attractor basins that is reversibly mod- 
ulated but not destroyed by the anti-Hebbian term. We notice that a similar dynamics has 
been studied by Kawamoto and Anderson for the particular case P = 2 intending to model 
visual pattern reversion in the Necker cu 



ibe • Here we extend that study to general num- 
ber of patterns P. Also Hoshino et al. 3| used a similar anti-Hebbian dynamics with an 



asymmetric coupling matrix to study transitions between fixed points and cycles. Here we 
are interested in the chaotic itinerancy phase that already appears with the simpler Hebbian 
matrix. 

Our results are presented in terms of low dimensional order parameters ( "overlaps" ) that 
measure the correlation (cosine) between the state vector of the network and the stored 



patterns, m^t) = J2f=i 3j(t)^/{\S(t)\\^\), where |^| = VN and |S(t)| are the vector 
Euclidian norms. In Fig. |21 we show an example of time series of the overlaps for P = 10 
patterns. We define an (arbitrary but not crucial) threshold A = 0.8 so that we consider 
that a pattern (or its anti-pattern) is being visited if \m^\ > A. The S(t) trajectory is indeed 
chaotic, as can be verified by observing the distance d(t) = ^ (Si(t) — S'^t)) 2 between two 
orbits S(i) and S'(t) with very small differences in initial conditions (Fig. (2J) ■ 

From the time series one gets the symbolic time series where only appears the pattern 
(if any) being visited (Fig. HJ). Although we report here only simulations with N = 100 and 
a = P/N = 0.1, we have checked that the itinerancy occurs until a effective critical storage 
a c oc 0.2. This value is higher than the standard critical capacity a c = 0.14 due to the effect 
of the anti-Hebbian term which is similar to unlearning algorithms 0. 

From extensive symbolic time series one obtains statistics about transitions and residence 
times (Fig 03). A not so obvious result is that, in a large parameter region, all patterns are 
visited with almost equal frequency (Fig. |S] inset). This finding is similar to that found in 
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FIG. 2: Time series of overlaps moduli |m^| for P = 10, with e = 0.009, r = 600 and N = 100. 
Nara model (f| . 

We define T^ v as the relative frequency matrix of transitions from pattern v to pattern \i. 
In simple stochastic trap models Q] the T^ v elements are similar (there is no preferential 
transitions between attractors). In our deterministic model, in contrast, the transition 
matrix is very inhomogeneous, as can be seem by a rank plot of T^ u values (Fig. 5). 

Up to now we have reported the presence of chaotic itinerancy between the stored patterns 
without external input (ij = 0). This corresponds to a spontaneous itinerant network 



activity, as devised by Freeman [14J. This author postulates that, under the presence of some 
input, the chaotic itinerancy should collapse to an attractor of lower dimension representing 
that input. Our model is a computational implementation of Freeman's ideas. A new 
feature is that this lower dimensional attractor also has a chaotic itinerant nature (with less 
components). 

Think about a mouse receiving a complex mixture of odours (each odour being represented 
by an initial pattern in its olfactory glomeruli layer). Galan et al. have recently observed 
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FIG. 3: Distance between trajectories d(t) as a function of time. The two systems have identical 
initial coupling matrixes and differ only in the first neuron, |5i(0) — 5^(0)| = 10 -15 . 



experimentally that glomerulli show Hebbian (correlational) plasticity, and that a Hopfield 
network is a viable model of the glomerular layer jjjljj. Following Adachi et al.jlG], we 
propose that chaotic itinerancy between input components may be a mechanism to analyse 
such complex input by using temporal segmentation. In a loose sense, we have a chaotic 
itinerancy projected into the subspace spanned by the patterns that compose the mixture 



input vector 
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In Fig. ink we show the network response to inputs made of a mixture of Q patterns 
Ii = (H/ y/Q) Ylv=i £f> where the input intensity is H. In Fig. we have a bifurcation 
plot as a function of H showing that there is a robust interval where the system itinerates 
only between the Q vectors that form the total input. This result is generic in parameter 



6 




FIG. 4: Label of the visited pattern as a function of time. The system itinerates chaotically but 
with almost equal frequency between the stored patterns (P = 10 and ./V = 100). 

space and is valid from Q = 1 up to Q = 0.6P. This means that the system makes a 
temporal segmentation even if the input is composed by an extensive number of patterns. 
For increasing odor intensity H the nature of itinerancy changes following a series of plateaus. 
We conjecture that this could be the theoretical correlate of a well known phenomenon where 
smells change abruptly of subjective character as a function of odour concentration jsoj ] - 

Although temporal segmentation is an intersting feature of the model, the more recent 
view is that odours are represented as sequences of patterns of glomerular activation, that 
is, a spatio temporal combinatorial code fisl . . The model allows such interpretation, if 
we think the patterns £ M as being not odour representations but as forming a basis to combi- 
natorially represent odours. In this scenario, we have upt to C = P\j (Q\(P — N)\) possible 
representations with Q components. For example, with a typical vertebrate glomerular layer 
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FIG. 5: Rank plot of the values of the transition frequencies T^ u . Inset: Average residence times 
near each pattern. 

with N = 1000 glomeruli and assuming P = 50 and Q = 3 (that is, odours will be repre- 
sented as sequences of three patterns), we have C =~ 20, 000 odours, which is already above 
the conjectured number of odours recognized by mammals. 

Another possible application for chaotic itinerancy phenomena is as a theoretical frame- 



work for understanding multistability in visual phenomena [22|. Here, an ambiguous figure 
would correspond to a mixture input where the Q components are the Q possible interpre- 
tations of the figure (see Fig. |7J). Visual multistability phenomena will be studied compu- 
tationally and experimentally in another work. A preliminary finding is that, both in the 
model and in experiments, the transition frequency between patterns grows with Q, showing 
that competition between the Q patterns (and not only fatigue factors) modulates the rate 
of transition between patterns. 
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FIG. 6: a) Network response to an input composed by Q = 6 patterns (fi = 1 to fi = 6) with 
H = 1.2. The input starts at t = 5000. b) Total number of patterns visited as a function of the 
input intensity H. Notice that for n < 6, all patterns are input components. 

Our model differs from previous itinerant systems in regard to: 



In contrast to Kaneko coupled lattices [4j|, the number P of quasi-attractors (patterns) 

can be set in advance and a study in function of a = P/N can be done; 

n 

Differently from Nara model p, we do not need to dilute the network to obtain 
itinerancy. This preserves a large capacity a c without requiring sophisticated (pseudo- 
inverse) learning matrixes. This large capacity (and larger stability of each individual 
pattern) enables us to show that pattern separation (by temporal segmentation) can 
be done for inputs with a high level of mixture (up to 0.6a or higher). This should be 
contrasted to very recent attempts of using chaotic itiner ancy for pattern separation 
where mixture inputs have only two or three components [17| ; 



In contrast to Aihara [24j and Kaneko |4( models, we do not need to use individual 
chaotic elements to obtain global chaotic itinerancy. We think that it is important to 
stress this point: chaotic itinerancy and local chaos are independent concepts; 
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FIG. 7: Example of visual multistability 23| where transitions between several patterns can be 
observed. 

• Of course, the advantages have a price: our system is composed of a 0(N 2 ) number 
of equations in contrast to 0(N) equations of previous itinerant systems. 

We notice that the same anti-Hebbian process can be implemented in other rugged land- 
scapes systems like, for example, a Sherrington-Kirkpatric (SK) model with zero temperature 
parallel dynamics. We expect a similar or more complex itinerant evolution due to the ex- 
ponential number of minima in these systems. In such spin glass-like system, however, since 
we do not know a priori where the minima lie, we may study energy and autocorrelation 
functions instead of the overlap m^(t) available in neural networks systems. In these sys- 
tems, our anti-Hebbian slow process could be though as an energy paving search method 
with some similarity to other methods proposed in the literature |25| |. 

A final observation is that we studied only the itinerant "equilibrium regime" , meaning 
that in the parameter region examined the transition frequency matrix appear to have a time 
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independent form. However, for small step sizes e, one should expect a scenario where the 
overall trajectory is transient, stopping at the most stable attractors. So, transient itinerant 
dynamics could be relevant as an alternative proposal for fast (non thermal) dynamical 
mechanism to produce convergence to a "native" state in the protein folding problem. It 
is also conceivable an out of equilibrium "glassy" scenario, probably in the large a regime, 
where the residence times may strongly depend on the relative stability of the local minima 
and the mean residence time diverges like in trap models . 

Out-of-equilibrium chaotic itinerancy is a topic for future work. These transient and 
glassy regimes are of interest because the complex time evolutions of the biological or socio- 
economical systems cited in the introduction are primary examples of such out-of-equilibrium 
( "historical" ) dynamics. As at least one concrete suggestion for these problems, our study 
illustrates the idea that the competitio ("dialectics") between short term stabilizing and 
long term corrosive internal factors is a sufficient conditions to produce a punctuated, rev- 
olutionary history where, even following a deterministic dynamics, future is not predictable. 
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